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Abstract — We consider the time-continuous doubly-dispersive 
channel with additive Gaussian noise and establish a capacity 
formula for the case where the channel correlation operator is 
represented by a symbol which is periodic in time and fulfills 
some further integrability and smoothness conditions. The key to 
this result is a new Szego formula for certain pseudo-differential 
operators. The formula justifies the water-filling principle along 
time and frequency in terms of the time-continuous time-varying 
transfer function (the symbol). 

I. Introduction 

The information-theoretic treatment of the time-continuous 
' channel dispersive in time and frequency (doubly-dispersive) 
with additive Gaussian noise has been a problem of long 
interest. A well known result for the time-invariant and power- 
. limited case has been achieved by Gallager and Holsinger 
' fTl and (2] in discretizing the time-continuous problem into 
. an increasing sequence of parallel memoryless channels with 
' known information capacity /„ . Coding theorems for the time- 
discrete Gaussian channel can be used for the time-continuous 
' channel whenever such a discretization is realizable. A direct 
. coding theorem without discretization has been established 
'by Kadota and Wyner (3] for the causal, stationary and 
asymptotically memoryless channel. 

The discretization in ||2j was achieved by representing a 
single use of the time-continuous channel as the restriction 
of the channel operator to time intervals ail of length a. The 
quantity /„ is then determined by spectral properties of the 
restricted operator A major step in the calculation for the 
time-invariant case was the exact determination of the limit: 



lim 



— lim In{aS) 

a n— >oo 



(1) 



which relies on the Kac-Murdock-Szego result |4| on the 
asymptotic spectral behavior of convolution operators. As the 
classical result of Shannon for the time-continuous band- 
limited channel and the discussion in [5| shows, I{S) has 
only a meaning of coding capacity for given power budget 
S whenever there exists a sequence of nested intervals of 
length ak (i.e. realizable discretization) approaching this limit 
as k ^ oo. Some remaining problems in this direction, like 
for example the robustness of this limit against interference 
between different blocks, have been resolved for Gallager- 
Holsinger model in [6|. The limit has the advantage of nice 
interpretation as "water-filling" along the frequencies: 

I{S) = / \og{B ■ a{uj))duj (2) 

Jb-<j{u)>1 

where a denotes the symbol of the correlation operator L^r 
(requu-ed to be absolute integrable and bounded). The constant 



B is implicitly determined for a given power budget 5 by a 
relation similar to (|2}. 

Since the time-invariant case represents the commutative 
setting a fixed signaling scheme (like for example orthog- 
onal frequency division multiplexing) is permitted and the 
determination of the capacity is essentially reduced to a 
power allocation problem. Although the coherent setting (full 
knowledge at the transmitter) is considered so far only the 
channel gains have to be given to the transmitter in this case. 

However, doubly-dispersive channels represent the non- 
commutative generalization and do not admit a joint diago- 
nalization such that there still remains the problem of proper 
signal design. Here, the correlation operator can be charac- 
terized for example by the time-varying transfer function, 
i.e. the symbol fT(a;,aj) of a so called pseudo-differential 
operator L^r which depends on the frequency uj and the time 
instant x. Obviously, by uncertainty an exact characterization 
of frequencies at time instants is meaningless and the symbol 
can reflect spectral properties only in an averaged sense. Thus, 
it is important to know whether the limit in ([T]i for a real- 
valued symbol is asymptotically given by the average: 



1 



r{B ■ a{x, uj))dxduj 



(3) 



aOxI 



for a "> OO and r{x) = log(x) • X[i,oo)(2;)- Then, ^ with 
a similar integral with the function {x — \)/x ■ X[i.oo)(2;) 
represents the water-filling principle in time and frequency. 
Obviously, this strategy is used already in practice when 
optimizing rate functions in some long-term meaning. But, 
in fast-fading scenarios for example it not clear whether this 
procedure on a short time scale is indeed related to ([!}. 

Averages closely related to the one in (|3} have been studied 
for a long time in the context of asymptotic symbol calculus 
of pseudo-differential operators and semi-classical analysis in 
quantum physics [T|, ['81, f9l. Unfortunately, the results therein 
are not directly applicable in the information and communi- 
cation theoretic setting because here 1.) the symbols of the 
restricted operators are (in general) discontinuous and usually 
not decaying in time 2.) the functions r to be considered 
are neither analytic nor have the required smoothness 3.) the 
path of approaching the limit has to be explicitly in terms 
of an increasing sequence of interval restrictions (infinite- 
dimensional subspaces) in order to establish its operational 
meaning. For operators with semigroup properties as for 
example the "heat channel" [lOJ it is possible to approach 
the limit via projections onto the (finite-dimensional) span of 
an increasing sequence of basis functions (Hermite functions 
in this case) as established in LI U for Schrodinger operators. 



However, in the problem considered here this approach does 
not guarantees the existence of signaling schemes of finite 
length a to practically achieve the limit and a semigroup 
property of this particular type is not present. 

The idea of approximate eigenfunctions of so called 
underspread channels 112], [13,1 has been used to obtain 
information-theoretical statements for the non-coherent set- 
ting 1141 . Signal design has then to be considered with respect 
to statistical properties [15|. The method presented in this 
paper suggests that in the coherent setting the approximation 
in terms of trace norms is relevant. 

A. Main Results 

We establish a procedure for estimating the deviation of 
formula Q from the desired quantity ([1}. It will be shown that 
both terms asymptotically agree for a ^ oo if the difference 
of symbol products L^r and operator composition LcLr can 
be controlled in trace norm on afl with a sub-linear scaling in 
a. We will further discuss the information-theoretical impacts: 
As an example we will study in more detail symbols a{x,uj) 
which are fi-periodic in x. We will show that under certain 
integrability and smoothness assumptions on the symbol the 
limit in ([T]l is indeed given as: 



I{S) = 



r{B ■ a{x, uj))dxduj 



(4) 
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whenever the (inverse) Fourier transform of a{x, u) in uj (the 
impulse response of L^) is supported in a fixed interval. 

The paper is organized as follows: In Section|II]we introduce 
the channel model and establish the problem as a Szego 
statement on the asymptotic symbol calculus for pseudo- 
differential operators. The asymptotic behavior is investigated 
in Section Hn] as a series of four sub-problems: an increasing 
family of interval sections, the asymptotic symbol calculus, 
an approximation method and finally a result on "products" 
of symbols. Following this line of four arguments we are able 
to estabUsh (gji. 

II. System Model and Problem Statement 

We use Lp{il) for usual Lebesgue spaces (I < p < oo) 
of complex-valued functions on C M" and abbreviate 
Lp = Lp(K") with corresponding norms ■ For p = 2 
the Hilbert space has inner product {u, v) :— J uv. Classes 
of smooth functions up to order k are denoted with and 
/ = Ff is the Fourier transform of /. Partial derivatives of a 
function (t(x,w) are written as ax and o-^j, respectively. I2 
and Ii are Hilbert-Schmidt and trace class operators with 
square-summable and absolute summable singular values and 
the symbol tr(X) denotes the trace of an operator X (more 
details will be given later on) on L2. 

A. System Model 

We consider the common model of transmitting a finite 
energy signal s with support in an interval aVl of length 
a through a channel represented by a fixed linear operator 
H and additive distortion n^, i.e. quantities measured at the 
receiver within some interval are expressed as noisy correlation 
responses: 

{rk,Hs)+nk (5) 



where {{rk,-)} ^6 suitable normalized linear functionals 
implemented at the receiver We assume Gaussian noise with 
E{nkni) = {rk,ri). 

Let us denote with {Pu){x) = the restriction 

of a function u onto the interval aft. Note that in what follows: 
P always depends on a. We will make in the following the 
assumption that the restriction HP of the channel operator H 
to input signals of length a with finite energy is compact, i.e. 
the restriction PL^P of the correlation operator H*H 
is compact as well {H* denotes the adjoint operator on L2). 
This excludes certain channel operators - like the identity - 
which are usually referred to as "dimension-unlimited", i.e. 
the wideband cases. Assume that the kernel fc(a;, y) of L„ 
fulfils for all a; e R: 

|fc(a;,a;- < (6) 

for some Then its (Kohn-Nirenberg) symbol 

or time-varying transfer function is given by Fourier transfor- 
mation: 

<t{x,uj) = J e'^'"^^''-yh{x,x~y)dy (7) 

Throughout the paper we assume that a is real-valued (this 
can be circumvented when passing to the Weyl symbol since 
Lrr is positive-definite). It follows that ||cr(x, •)|||^^ < 
uniformly in x and that is bounded on L2: 

\{u,L„v) \ ^\{u®v,k)\< {\u(x)v\, y/^P) 

= {\u\,^j*\v\) < 

From now on we use ||-||op := IM|l2^L2 to denote the operator 
norm on L2. A compact operator HP can be written via the 
Schmidt representation (singular value decomposition) as a 
limit of a sum of rank-one operators HP = J2k ^k{uk, ■)vk 
with singular values Sfc — Xk{PLaP) and orthonormal 
bases {uk} and {ufc} - all depending on a. For the coherent 
setting we assume that finite subsets of these bases are known 
and implementable at the transmitter and the receiver, respec- 
tively. Obviously, this is an idealized and seriously strong 
assumption which can certainly not be fulfilled without error in 
practise. The investigations in lfT6l suggest that underspread- 
ness of H is necessary prerequisite for reliable error control. 
When representing the signal s as a finite linear combination 
of {ufc} a single use of the time-continuous channel H over 
the time interval aJl with power budget S is decomposed into 
a single use of a finite set of time-discrete parallel Gaussian 
channels jointly constrained to aS. 

We will consider in the following independent uses of the 
channel in (|5]l as our preliminarjH model and restrict to = 
Vk, i.e. E{nkni) = 6ki- Then, the capacity and the power 
budget of the equivalent memoryless Gaussian channel are 
related through the water-filling level B as (see for example 
Ui): 

- V log(BAfc) = -tr„r(BPL,P) 



(8) 
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BAfc>l 



BXl 



-iv^piBPL^P) 
a 



'sup^gjj k(x,x - •) G -Li n L2 

^We discuss consecutive uses of the same time-continuous channel below. 



with r{x) = log(x) • xii,cx,){x) and p{x) = ^ ■ X[i,oo)(a;). 
The symbol tTaY := tT{PYP) denotes the trace of the 
operator Y on the range of P and the operators r{PXP) and 
p{PXP) for X being self-adjoint are meant by the spectral 
mapping theorem. 

If the time-varying impulse response of (or H) has 
finite delay x — z) is zero for z outside a fixed interval) 
and is periodic in the time instants x (the symbol (7(0;, w) is 
periodic in x) multiple channel uses in the preliminary model 
can be taken as consecutive uses of the same time-continuous 
channel. Inserting guard periods of appropriate fixed size 
(independent of a) will not affect the asymptotic behavior for 
a — ?► 00. Thus, any further results will then indeed refer to the 
information (and coding) capacity. The assumptions on finite 
delay might be relaxed using direct methods like in \6\ or [17 1 
whereby extensions to almost-periodic channels seems to lie 
at the heart of information theory. 

B. Problem Statement 

The interval restriction P has the symbol xi^lct)- The sym- 
bol of operator products is given as the twisted multiplication 
of the symbol of the factors. Under the trace this is reduced 
to ordinary multiplication (see for example [18] in the case of 
Weyl correspondence). Thus, the term in Q can be written as 
the following trace: 

1 If 

— \laLf,„)^— f{(T{x,uj))dxduj (10) 

when taking f{x) = r{Bx). Comparing (|9|l with ( fTOl i means 
to estimate the asymptotic behavior of: 



-tr„ ifiPL^P) 
a 



(11) 



for a — 00 (we abbreviate /(cr) '■= f o a). As seen from r 
and p in (|9]l the functions / of interest are continuous but not 
differentiable at a: = 1. 

III. Asymptotic Trace Formulas 

The procedure for estimating the difference in (ITTl es- 
sentially consists in the following arguments: A functional 
calculus will be used to represent the function / in the operator 
context. For Ljf^') this can be done independently of a but 
for f{PLcP) such an approach is much more complicated 
because of the remaining projections P. Hence, the first step 
is to estimate its deviation to f{L„) by inserting the zero term 
tr, (/(i,) - f{L„))/a into O: 

Stability symbol calculus 



1 



-(tr„ [f{PL,P) - /(£.)] +ti-„ [f{L„) - L^(,)] : 



(12) 



a 



and use |tr (a + 6)| < |tra| + |tr6| to estimate both terms sep- 
arately. The first contribution refers to the stability of interval 
sections (in Section IIII-Ab . For second term a Fourier-based 
functional calculus reduces the problem to the characterization 
of the approximate product rule for symbols (in Section IIII-Bl i 
which can then be estimated independently of the particular 
function / (in Section IIII-DI) . Unfortunately, the last steps 
require certain smoothness of /. Therefore we will approach 
the limit via smooth approximations as discussed in Section 

EEl 



A. Stability of Interval Sections 

The following stability result was inspired by the analysis 
on the Widom conjecture in |19|. Let spec(L(j) denote the 
spectrum of L^- Then the interval / :— lJtG[o 1] ^ ' spec(io-) 
contains the spectra of the family PL^P for each a. 

Theorem 1. Let L„ be an operator with a kernel which fulfils 

\k{x,x- z)\'^ < i}j{z) with ijj e Li. If Uil - X[~s,s])\\li < 
c/s then: 

-\tr^ ifiPL^P) - f{L,))\ < ||/"|U^(/)i^ (13) 
a a 

forfeWlil). 

W^{I) denotes the Sobolev class (details in |20|). Recall 
that the functions / to be considered here are continuous and 
differentiable a.e. on / (except at point x — 1). We will shortly 
discuss the proof of this theorem since it is only a minor 
variation of llT9l . 

Proof: Laptev and Safarov |20J have obtained from 
Berezin inequality the following estimate. For functions / G 
W^{I) the operator P[fiL^) - f{PL^P)]P is trace class 
if PLcr and PL^^l - P) are Hilbert-Schmidt with the trace 
estimate: 

K (/(i.) - fiPL.p))\ < l\\n\Lui)\\PLAi p)\\i 

(14) 

Recall that the interval projection P is multiplication with 
the scaled characteristic function x(x/a). Thus, change of 
variables x = y' + x' and y = y' — x' gives: 



(15) 



\\PLAh = J X{x/a)\k{x,y)\''dxdy 

< 2a^ J 'i(;{2ax')dx' J xiv' + x')dy' < a\\^lj\\i 
In the same manner we get: 
\\PL,il-P)\\l= I ^(^)(l-^{^))\kix,y)\'dxdy 

-^^ J X{x){l - x{y))i^{a{x - y))dxdy (16) 
= "0(200;) • uj{2x)dx 



with uj{x) := 4:\x\ < 2 for < 1/2 and uj{x) := 2 outside 
this interval. With u — 2ax and = V'(w) + ip(—u) we 
split and estimate the integral as follows: 



/>oo 

\PL,{1-P)\\l^- HuM^)dv 



S f , f in 







^ + 2 / ) ^{u)du 

2 J2a 



(17) 



and with the assumptions of the theorem it follows: 

||PL,(1-P)|||^ =4||V||i + 2 j ^{u)udu+\ 



(18) 



Finally we use 4'{u) — —-^ (j){s)ds and integrate by parts 
to obtain J^°' (l){u)udu — c(l -I- log a). ■ 



B. Asymptotic Symbol Calculus 

Here we shall use Fourier techniques to estimate the 
right term in (fTZt . We abbreviate in the following e{x) — 
exTp{i2nx). 

Lemma 2. Let f be a Li-function with f{uj) ~ 0{uj^'^^^) 
for some S > 0. For L„ being bounded and self-adjoint on 
L2 with real— valued symbol a £ it follows that: 

^|fra(/(L,)-L/(,))| < Jdw\f{u)\J^ Qcis)^ (19) 

with Qa{s) := ||(iCTie(s<T) - L^eisa)) P\\li- 

The lemma shows that whenever the rhs in (fT9T l is finite 
the asymptotics for a — >■ 00 is determined only by Qa/ct. 
The function Qa essentially compares the twisted product of 
a and e{sa) with the ordinary product cr • e{sa) in trace norm 
reduced to intervals of length a. 

Proof: Consider the following operator-valued Bochner 
integral: 

f{L,) = / eiLuL,)f{u)dcu (20) 



where the operator e{ujLa-) is defined as the usual power series 
converging in norm since L^, is bounded. In particular e{ujLcr) 
is unitary on L2 {L^ is self-adjoint) and depends continuously 
on uj. Since ||/(-Zjo-)||op < ll/lli convergence in operator norm 
is guaranteed and the construction agrees with the spectral 
mapping theorem (see 121]). The value of the symbol /o cr at 
each point can be expressed in terms of /. This suggests the 
formula: 

^fM = / Le(ua)f{^)duJ (21) 



From Calderon Vaillancourt Theorem 1122] Ch.5] we have: 



a+b<3 



(22) 

Thus, for /(w) = 0(^-4--^) and 5 > the integral ^ 
converge in the sense of Bochner From the considerations 
above we get therefore: 



|tr„ - f{L,))\ < J \f{uj)\ ■ \ti-^uiu;)\duj (23) 

with u{uj) — Lcre{ujLa) ~ icre(w(T)- As suggested in ||9] the 
operator w(a;) fulfils the following identitjo 



u{uj) = i2Tr [Lcu{lo) + Lc,Le(^„) - £o-e(c^cr)) 



(24) 



i.e. an inhomogenous Cauchy problem with initial condition 
m(0) = 0. By Duhamel's principle (see for example 1,24. p. 50] 
for the Banach-space valued case): 

u{uj) = — e{{uj - s)L„) (L^Le(s^) - io-e(so-)) ds (25) 
* Jo 

giving the estimate: 

\\IaU{uj)\< / \\{L^L^(^sa) - L„e(^sa)) P\\lids (26) 

Jo 

since ||Pe((i-s)L^)||op < 1. ■ 

'in case of operators; dije{ujLa-) = i2-KLae{u)La) 1231 Lemma 5.1]. 



The smoothness assumptions in the theorem can be weak- 
ened to a- e C"^^^ and /(w) = 0{lo~^~^) when using Holder- 
Zygmund spaces. We expect that these conditions can be 
further reduced when using in (l2ll some weaker convergence 
in iXa instead of requiring a Bochner integral. The proof of the 
theorem can also be based on the Paley- Wiener theorem, i.e. 
/ — > f{La) and / — > Lf(^^) are operator-valued distributions 
of compact support with order at most 3 and have therefore 
as natural domain. 

C. An Approximation Procedure 

Since L^r is bounded (see (jSJ) the functions / will be 
evaluated only on a finite interval contained in /. We consider 
functions / of the form f{x) = h{x) ■ X[i,oa){^) with a 
critical point at a; = 1. By smooth extension outside the 
interval its Fourier transforms /(w) decay only as 0(aj^^), 
see here for example [25, Theorem 2.4], i.e. / e Li n FLi. 
Unfortunately, this is not sufficient for Lemma |2] Therefore, 
we replace the Heaviside function X[i,oo) in / by a series of 
smooth approximations as done for example in |8|. Let 
be e C°° with = for t < and (j){t) = 1 for 
t>l. Define ^^(a;) = (/>(^) and consider = h<j)^ £ 
(a smooth function of compact support, achieved again by 
smooth extension outside the interval /) instead of /: 



(27) 



In essence: polynomial grow of Qa{s) in s can always be 
compensated by taking n large enough such that at the rhs in 
( fT9] l remains a finite quantity Ra{()- If for example Ra{e) = 



0{a '''), we choose e — a with d < ^/n. Then Raie) 







and e 
limit. 



for a ^ oo which is obviously sufficient for the 



D. Approximate Symbol Products 

Let us abbreviate r = e{sa). Then the operator in the term 
Qa{s)/ct of Lemma |2] is the deviation between operator and 
symbol product L^Lct — I^<jt- As in Q we insert La-L% — 
L^L*, and apply triangle inequality to obtain: 



Qci-s) < ||L,||op||rP||xi + \\T'P\\x, 



(28) 



where T — L% — and T' = LcrL% — L^t having kernels 

t{x,y) and t'{x,y): 



tix,y)= / e'^''^''-y^'^{T{x,uj) - T{y,uj))duj 



t'{x,y) 



— / „«27r(a;-jf)w 



(29) 



(t(x, w)(r(x, uj) — T{y, uj))du! 



Polynomial orders in s which will occur in the following will 
be compensated by the approximation method in Section lTlI-CI 
The role of r and a can also be interchanged since according 
(I22I 1 Lr is bounded polynomially in s. 

We will discuss in the following under which conditions 
||rP||ij^ is finite and what will be scaling in a. The argu- 
mentation for ||T'P||ij will be analogous. From integration 
by parts (since r(.x, cj) — T(y, w) — ^ for \uj\ — > 00) we have: 

h{x,X'- y) - h{y,x - y) 



t{x,y) 



i2'K(x — y) 



(30) 



where h{x,z) = J e^'^^'^^Ti^{x,uj)duj and |r(^| — \2TTsa^\. It is 
already assumed that a{x, ■) e L2 uniformly in x. If (Juj{x, •) 
is of bounded variation (or even continuous) we deduce with 
the mean value theorem that \t{x,y)\'^ < c/(l + \x — yp). 
This in turns implies that ||rP||x2 = C>{y/a) but it will not 
be sufficient for ||rP||ij. 

It is known that general trace class estimates can not be 
achieved in this way and further smoothness assumptions are 
necessary. The problem is related to the absolute summability 
of orthogonal series (in particular Fourier series as shown later 
on) which is evident from: 



IITFII 



< 



where is an ONB for the range of P (supp0„ C ail). 
However, for finite-rank TP it follows here already from 
llT'^nlUa < Il'7"^'l|i2 = ^iV^) that the approximation 
method in Section IIII-CI can be applied giving the correct 
statement in ( fTTT ). 

Let be c„ a (positive) sequence 1 /c„ — > as ?i — ^ 00 with 
K — J2n^n^^ being finite for A > 1/2. Holder inequahty 
implies: 



\TP\\i < K 



K 



KT(t>n\\ 



\{t[z- 



(32) 



The periodic case: Let us assume that t{z + y, y) is periodic 
in y (same for t') with period 1 (for simplicity) which is given 
if the symbol a{x,Lo) is 1-periodic in x. We use the Fourier 
basis 4)n{y) — exp(i27rri?//a)/-y/a and consider a e N and 
— [0, 1], i.e. t is given by the series: 

t{z + y,y)^ Va^Un{z)(j)am{y) (33) 



The sum in (DZb reduces to the indexes an. We take exemplary 
A = 1, Can = "ii^n and Can+k = 2Tr\/a — In for fc = 1 . . . a— 
1 such that K is independent of a. Then (l32b is: 

||TP||i, <V^(^K Jj2 |2W™(z)|2dz^ (34) 

which results in the condition ty E ^2(1^ x ^) (to be precise, 
the derivative in the i2-inean - see ||26| ). From the definition 
of t in dm it follows that: 



where |Ta;| = 27rs|cr2;|- Thus, the latter condition is fulfilled if 
ax{x,-) S Li and the derivative in u has bounded variation 
(or is continuous). Thus, in this case the method in Section 
IIII-CI can be applied which proves formula (|4]l. 

IV. Conclusion 

A new approach to the capacity of time-continuous doubly- 
dispersive Gaussian channels with periodic symbol has been 
established by proving an asymptotic Szego result for certain 
pseudo-differential operators. 



[2 



[3: 



(31) [4: 



ty{z + y,y)= I e'^^'^ {Tx{y + z,iu)-T,{y,w))dw (35) [21 

[22 
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